Automatic Evaluation Of Summaries Using Document Graphs
نویسندگان
چکیده
Summarization evaluation has been always a challenge to researchers in the document summarization field. Usually, human involvement is necessary to evaluate the quality of a summary. Here we present a new method for automatic evaluation of text summaries by using document graphs. Data from Document Understanding Conference 2002 (DUC-2002) has been used in the experiment. We propose measuring the similarity between two summaries or between a summary and a document based on the concepts/entities and relations between them in the text.
منابع مشابه
Developing Infrastructure for the Evaluation of Single and Multi-document Summarization Systems in a Cross-lingual Environment
We describe our work on the development of Language and Evaluation Resources for the evaluation of summaries in English and Chinese. The language resources include a parallel corpus of English and Chinese texts which are translations of each other, a set of queries in both languages, clusters of documents relevants to each query, sentence relevance measures for each sentence in the document clu...
متن کاملA survey on Automatic Text Summarization
Text summarization endeavors to produce a summary version of a text, while maintaining the original ideas. The textual content on the web, in particular, is growing at an exponential rate. The ability to decipher through such massive amount of data, in order to extract the useful information, is a major undertaking and requires an automatic mechanism to aid with the extant repository of informa...
متن کاملA News Summarization System using Fuzzy Graph Based Document Model
This paper describes a news summarization system using the Fuzzy Graph based Document Model. News articles are modelled as fuzzy graphs whose nodes are sentences and edges are weighted by the fuzzy similarity measure between the sentences. The similarity between sentences is in between 0 and 1. Centrality of the graph retrieves important sentences. The proposed system produces summaries by Eige...
متن کاملSentence Selection for Extractive Summaries in PARE
1. ABSTRACT As the amount of text available from electronic sources continues to increase, the study of automatic text summarization is more important now than it has ever been. Automatically generated summaries should be clear and concise without giving unimportant or redundant information. The process of extractive text summarization involves determining the most important sentences in a docu...
متن کاملUsing Background Information for Multi-document Summarization and Summaries in Response to a Question
In our second participation to the DUC evaluation, we used the SumUM system for the multidocument summarization focused by events task and summaries in response to a question task. Our multi-document summarization algorithm is based on the use of background information gathered by summarizing previous texts, which is then combined with a new document of the cluster. For producing the summaries ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004